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(g) An Image defect correcting circuit for a solid state imager. 



(57) An Image defect correcting circuit for a solid state imager Is arranged such that levels of output 
signals of pixels of a solid state image pickup element (51 R, 51 G, 51 B) Illuminated on its whole surface 
with a light of uniform brightness are compared with a predetennined level, data indicative of a position 
of a pixel which outputs a signal of peculiar level is generated on the basis of the compared result a 
vWeo signal output from at least the pixel located at the positton indicated by the position data' is 
interpolated by using output signals of other pixels according to an interpolatton processing (63) and 
the output signals of the respective pixels and the video signal generated by the interpolation 
processing are selectively output on the basis of the position data. 
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AN IMAGE DEFECT CORRECTING CIRCUIT FOR A SOLID STATE IMAGER 



BACKGROUND OF THE INVENTION 
Field of the Invention 

' * The present invention generally relates to an 
Image defect correcting circuit for a solid state Imager 
which corrects Image defect Involved in an output 
Image of a solid state image pickup element. More 
particulariy, this Invention relates to an image defect 
correcting circuit for a solid state imager in which an 
image defect Involved in an output image of a solid 
state image pickup element is corrected in accord- 
ance with an image defect position information gen- 
erated on the basis of an output of the solid state 
image pickup element. 

Description of the Prior Art 

Of pixels (picture elements) of a solid state image 
pickup element, a pixel, which is not operated nor- 
mally due to lattice defect or the tike, is what might be 
called a blemish. Of the blemishes, a blemish pro- 
. duced by a pixel which generates a large voltage as 
compared with other normal pixels, is called a white 
blemish, while a blemish produced by a pixel which 
generates a small voltage or which produces substan- 
tially no voltage as compared with other normal pixels, 
is called a black blemish. . 

Figs. 1A to 1F show^ when an iris of a so-called 
three CCD (charge coupled device) type television 
camera is closed, respectively* its solid state image 
pickup elements r, g and b and red, green and blue 
video signals Vr, Vg and Vb output from these solid 
state image pickup elements r, g and b. 

As is clear from Figs. 1A to 1F, since the solid 
state Image pickup elements g and b shown in Figs. 
1 C and 1 E have no blemish, the video signals Vg and 
Vb from these solid state Image pickup elements g 
and b have level corresponding to the level under the 
condition such that no light is incident thereon as 
shown In Figs. 1 D and 1 F. On the other hand, the solid 
state image pickup element r shown in Fig. 1 A has a 
white blemish at a position shown by a solid arrow in 
Fig. 1A. Accordingly, as shown In Fig. 1B, in the video 
signal Vr from this solid state Image pickup element 
r, the level thereof becomes high at the position of the 
video signal Vr conrosponding to the pixel shown by 
the solid arrow in Fig. 1A. 

Figs. 2A to 2F show, respectively, solid stale 
image pickup elements r. g and b and red, green and 
blue video signals Vr, Vg and Vb output from these 
solid state image pickup elements r, g and b when the 
three CCD television camera similarly to Fig. 1 is used 
and a white diffusion plate (Illuminated In the direction 
opposite to the camera pick up direction by an illumi- 



nation and this condition will not be changed In the fol- 
lowing description) is picked up by this television cam- 
era. 

5 As Is clear from Figs. 2A to 2F, since the solid 

state image pickup elements g and b shown In Figs. 
2C and 2E have no blemish, levels of video signals Vg 
and Vb from these solid state image pickup elements 
g and b are equal to levels In which the respective 

10 solid state image pickup elements are illuminated on 
their whole surfaces with a light of unifonm brightness. 
On the other hand, the solid state image pickup ele- 
ment r shown in Fig. 2A has a black blemish at a posi- 
tion shown by a solid anrow In Fig. 2A. Accordingly, In 

15 the video signal Vr from this solid state image pickup 
element r, as shown in Fig. 2B, regardless of the fact 
that the solid state image pickup element r is illumi- 
nated on its entire surface with a light of uniform 
brightness, the level of the position of the video signal 

20 Vr conresponding to a pixel shown by the solid arrow 
in Fig. 2A becomes substantially zisro. 

When a video signal from the television camera 
having incorporated therein the solid state image 
pickup elements having white and black blemishes 

25 shown in Figs. 1 A to 1 F and Figs. 2A to 2F is supplied 
to and displayed on a monitor receiver, if an iris of the 
television camera is closed, a white blemish is dis- 
played on the picture screen of the monitor receiver. 
When the white diffusion plate, for example Is picked 

30 up by the television camera, a black blemish is dis- 
played on the picture screen of the monitor receiver. 

It Is substantially impossible to perfectly prevent 
white and black blemishes of the solid state image 
pickup element from occurring in the manufacturing- 

35 process of the solid state Image pickup element. 
Further, even in the solid state Image pickup element 
where no blemish is discovered In the manufacturing- 
process, it is frequently observed that a white or black 
blemish occurs in such solid state image pickup ele- 

40 ment during such solid state image pickup element is 
fabricated Into a housing of a television camera and 
is used as the television camera. 

Conventionally, as is well known from, for 
example, Japanese Patent Published Gazette No.60- 

45 34872jhe detection of blemish is^carried but on~eachv 

Is6lid state image pickup element, the position of the^ 
detected blemish In the solid state image pickup ele- 
ment is detected, and data indicative of the position of 
blemish is written In a read only memory (ROM). 
Then, the solid stale image pickup element and the 
ROM are Incorporated into the camera apparatus so \ 
ithat, when they are used as the television camera, on | 
the.t)asis of the^ata mdjcatrng the^p^siUpjyitbiea^^ 
read out from the ROM, a video signal output from a 
55 pixel having a blemish is interpolated by using output 
data from other normal pixels. 

3 
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Incidentally, according to the method in which the 
solid state image pickup element is inspected inde- 
pendently and address of defective pixel is written in 5 
the ROM, the solid state image pickup element and 
the ROM therefor must be constantly administered 
perfectly as a pain 

Further, when a new blemish occurs after the 
solid state image pickup element and the ROM as a io 
pair are incorporated Into the housing of the camera 
apparatus and bought by the user as the television 
camera, such camera apparatus is returned from the 
user, the solid state image pickup element and the 
ROM are again disassembled from the housing of the i5 
camera apparatus, and the solid state image pickup 
element is Inspected to detect a defective pixel and an 
address thereof. If the ROM is a so-called one-time 
ROM, a new ROM is prepared and rf the ROM is an 
EPROM (electrically programmable ROM), all data 20 
are erased and addresses of all defective pixels 
detected are written In the EPROM. Then, such solid 
state image pickup element and the ROM as a pair are 
assembled into the housing of the camera apparatus 
and returned to the user. 25 

As described above^ in the conventional image 
defect correcting apparatus, a corresponding relation 
between the solid state image pickup element and the 
ROM must be administered, and when new black 
blemish or new white blemish occurs after the assenrv 30 
biy-process, the solid state image pickup element and 
the ROM must be disassembled from the housing of 
the camera apparatus and data must be changed. 
Then, they must be again assembled into the housing 
of the camera apparatus, which is considerably cum- 35 
bersome. 

OBJECTS AND SUMMARY pF THE INVENTION 

Accordingly, it is an object of the present inven- 40 
tion to provide an improved image defect correcting 
circuit for a solid state imager in which the afore noted 
shortcomings and disadvantages encountered with 
the prior art can be substantially eliminated. 

More specifically, it is an object of the present 4S 
invention to provide an image defect correcting circuit 
for a solid state imager in which, even when a new 
crystal defect occurs in a solid state image pickup ele- 
ment, an image defect involved in an output image 
from that solid stale image pickup element can be cor- $0 
rected satisfactorily. 

It is another object of the present invention to pro- 
vide an image defect correcting circuit for a solid state 
imager in which, when an image defect involved In an 
output image from a solW state image pickup element 55 
is corrected by an interpolatton processing, a deterior- 
ation of image quality at the connected portion can be 
suppressed to the minimum. 

According to a first aspect of the present inven- 
tion, an image defect correcting circuit for a solid state 



imager is comprised of a comparator for comparing 
levels of output signals of pixels of a solid state image 
pickup element illuminated on its whole surface with 
a light of uniform brightness with a predetermined 
level, a position data generating circuit for generating 
data indicative of a position of a pixel which outputs a 
signal of peculiar level on the basis of the compared 
result of the comparator, an interpolating circuit for 
interpolating an output signal from the pixel located at 
the position indicated by the position data generated 
by the position data generating circuit by using output 
signals of other pixels and a change switch for selec- 
tively oulputting the output signals of respective pixels 
and an output signal of the at>ove interpolating circuit 
on the basis of an output signal from the position data 
generating circuit. 

As a second aspect of the present invention, an 
image defect conrecting circuit for a solid state imager 
is provided, in which a video information correspond- 
ing to a position of a defective pixel of a plurality of 
pixelsof the, solid state image pickup element is gen- 
erated on the basis of a video information from pixels 
located at other positions according to an interpo- 
lation processing. This image defect conrecting circuit 
for a solid state imager is comprised of a comparator 
for comparing levels of video signals derived from a 
plurality of pixels located In the vicinity of the defective 
pixel, a selecting circuit for selecting the video infor- 
mation of the pixel used in the interpolation proces- 
sing on the basis of the compared result from the 
comparator and an interpolating circuit for generating 
the video infonmation conresponding to the position of 
the defecUve pixel on the basis of the video infor- 
mation of the pixel selected by the selecting circuit 
according to the interpolation processing. 

The above, and other objects, features and 
advantages of the present invention will become 
apparent in the following detailed description of illus- 
trative embodiments thereof to be read in conjunction 
with the accompanying drawings, in which like refer- 
ence numerals are used to identify the same or similar 
parts in the several views. 

BRIEF DESCRIPTION OF THE DRAWINGS 

Figs. 1A to 1F are schematic diagrams, respect- 
ively, used to explain a white blemish involved in 
an output image from a solid state image pickup 
element ; 

Figs. 2A to 2F are schematic diagrams, respect- 
ively, used to explain a black blemish Involved in 
an output image from a solid state Image pickup 
element ; 

Fig. 3 (formed of Figs. 3A, 3B and 3C drawn on 
three sheets of drawings so as to penmit the use 
of a suitably large scale) is a block diagram show- 
ing a first embodiment of an image defect correct- 
ing circuit for a solid state image pickup element 
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according to the present invention ; 
Figs. 4, 5, 6 and 7 are flowcharts, respectively* to 
which references will be made in explaining oper- 5 
atlon of the image defect correcting circuit for a 
solid state imager shown in Fig. 3 ; 
Fig. 8 Is a schematic diagram used to explain an 
' interpolation processing done by a conventional 
■ image defect correcting circuit for a solid state io 
'^imager; 

* Fig. 9 is a schematic block diagram showing a 
' second emt}odiment of the image defect conrect- 

ing circuit for a solid state imager according to the 

' * present invention ; is 
' Fig. 10 is a schematic diagram showing a struc- 
ture of a solid state image pickup element which 
supplies a vkieo signal to the image defect cor- 
recting circuit for a solid state imager of the pre- 
sent invention ; 20 
Fig. 11 is a schematic diaigram showing in detail 
an interpolation information generating means 
used In the image defect correcting, circuit for a 
^> * solid state imager according to the present in ven- 
'-^ '* tlon shown in Fig. 9 ; 25 
' ^ Fig. 12 is a schematic diagram showing the con- 
' dition of pixels located in the vicinity of a defective 
' pixel of the solid state image pickup element 
"'^ which supplies the video signal to the image 
V defect correcting circuit for a solid stiate imager 30 
shown in Fig. 9 ; 

Fig. 1 3 is a table to which references will be made 
in explaining operation of a decoder shown in Fig. 
11; 

Figs. 14A and 14B are diagrams schematically 35 
showing stripe patterns in the horizontal direction 
picked up by the pixels near the defective pixel of 
the solid state Image pickup element shown in 
Fig. 12, respectively ; 

Figs. 15A, 15B and 15C are diagrams, respect- 40 
Ively, schematically showing stripe patternis 
oriented in the upper left direction picked up by 
the pixels near the defective pixel of the solid 
state image pickup element shown in Fig. 12 ; 
Figs. 16A, 16B and 16C are diagrams, respect- 4s 
ively, schematically showing stripe patterns 
oriented in the upper right direction picked up by 
the pixels near the defective pixel of the solid 
state image pickup element shown in Fig. 12 ; 
Figs. 17A and 178 are diagrams, respectively. so 
schematically showing stripe patterns in the ver- 
tical direction picked up by the pixels near the 
defective pixel of the solid state image pickup ele- 
ment shown in Fig. 12 ; 

Fig. 18 Is a block diagram showing in detail a 55 
defect position detecting means used in the 
image defect correcting circuit for a solid state 
Imager shown in Fig. 9 ; 

Fig. 19 is a block diagram showing a third embo- 
diment of the image defect correcting circuit for a 



solid state imager according to the present inven- 
tion ; and 

Fig. 20 is a block diagram showing a fourth embo- 
diment of the image defect correcting circuit for a 
solid state imager according to the present inven- 
tion. 

DETAILED DESCRIPTION OF THE PREFERRED 
EMBODIMENTS 

The present invention will, now be described in 
detail with reference to the accompanying drawings. 

Incidentally; Fig. 3 is formed of Rgs. 3A, 3B and 
3C drawn on three sheets of drawings so as to penmit 
the use of a suitably large scale, and illustrates one 
portion of a solid state imager according to the present 
invention and an Image defect correcting circuit 
thereof. Initially, three modes, which premise the solid 
state imager having the image defect correcting cir- 
cuit according to the present invention and a control 
system will be explained hereinafter, and then respec- 
tive sections of this apparatus will be explained. 

The solid state imager having the image defect 
correcting circuit according to the present invention 
has three modes, isuch as normal image pickup mode, 
an image pickup mode for detecting a defective pic- 
ture element (i.e., pixel) and a defective pixel desig- 
nating mode (this mode is selected by the user). In the 
nonmal image pickup mode, a correcting circuit sys- 
terh having a correcting function for correcting a 
defective pixel is operated. Further, the solid state 
imager of the present invention has a self-test function 
to automatically detect a defective pixel during one 
frame period when the solid state imager is powered. 
The aforenoted three modes are selected by the user, 
and if neither the image pickup mode for detecting the 
defective pixel nor the defective pbcel designating 
mode is selected by the user, the solid state imager 
is placed in the normal Image pickup mode after the 
self-test is finished when being powered. 

The control system will be explained next, and In 
the control system, a control pulse generator 21, a 
RAM (random access memory) controller 22, a micro- 
computer 23, a RAM 25, an EEPROM (electrically 
erasable and programmable read only memory) 24, a 
display section 28 and an operation section 29 are 
particularly associated with the above-described 
three modes. 

Address of blemish in the solid state image pickup 
element and data determining whether the blemish is 
white blemish or black blemish checked in the factory 
beforehand are stored in the EEPROM 24. The micro- 
computer 23 having a ROM and a RAM switches the 
three modes, i.e, the normal image pickup mode, the 
defective pixel detection image pickup mode and the 
defective pixel designating mode on the basis of a 
mode selecting signal from the operation section 29 
and data stored in the EEPROM 24 and performs the 
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self-test when the solid state imager is powered, 
thereby controlling the control pulse generator 21. 
Under the control of the microcomputer 23, the control s 
pulse generator 21 generates various control signals 
on the basis of address data from a line counter 19 
and a cell counter 20 which will be refenred to later. 

The RAM controller 22 controls the RAM 25 under 
the control of the microcomputer 23 so that, when the io 
solid state imager is actuated, data stored in the EEP- 
ROM 24 are stored in the RAM 25. new defective pixel 
data is stored in the RAM 25 or that the data is 
updated. The switching operation of the above-des- 
cribed three modes and so on are effected by the user is 
by operating the operation section 29 in accordance 
with the display on the display section 28, 

The respective sections of this apparatus will be 
explained hereinafter in the sequential order of the 
mode when the apparatus is actuated and the three 20 
modes. Incidentally, while the self-test in the actuation 
state must be explained initially, this self-test will be 
explained when the defective pixel detection image 
pickup mode is explained because the circuits and the 
operation of the self-test are substantially the same as 25 
those of the defective pixel detection image pickup 
mode. 

IniUaliy, the normal image pickup mode will be 
explained with reference to Fig. 3, 

Referring to Fig. 3, there is shown an image 30 
pickup optical system 1 which is composed of an iris, 
an iris driving means for driving the Iris by a drive sig- 
nal CP from the control pulse generator 21, a lens (not 
shown), a filter and so on (not shown). An image 
pickup section 2 is composed of three solid state 35 
image pickup elements (e.g., charge coupled devices 
or the like) in which object images, which result from 
analyzing the image pickup light into three primary 
color components such as red (R), green (G) and blue 
(B), are focused on the image pickup screens, 40 
The drive operation of the image pick up section 2 will 
be explained next A sync, (synchronizing) generator 
5a is adapted to generate a reference horizontal sync, 
signal and a reference vertical sync, signal on the 
basis of a reference clock from a clock generating cir- 45 
cult 4. A timing generator 5b is adapted to generate 
horizontal and vertical transfer pulses synchronized 
with the reference horizontal sync, signal and the 
reference vertical sync, signal from the sync, 
generator 6a. A driving circuit 3 is adapted to respect- so 
ively drive solid state image pickup elements of the 
image pickup section 2 on the basis of the horizontal 
and vertical transfer pulses from the timing pulse 
generator 5b. 

Referring back to the image pickup section 2, the 55 
image pickup video signals R, G and B from the image 
pickup section 2 are supplied through a pre-ampiifier 
6 and a video amplifier 7 for adjusting white balance 
to an analog-to-digital (A/D) converter 8. The image 
pickup video signals R, G and B are respectively con- 



verted into digital image pickup video signals 
(hereinafter referred to as digital video signals) by the 
A/D converter 8. The respective digital video signals 
R, G and B from the A/D converter 8 are respectively 
supplied to delay devices 9, 10 and11, each being for- 
med of a charge coupled device (CCD) or the like. 
These digital video signals R. G and B are delayed by 
predetemiined delay times by these delay devices 9, 
1 0 and 1 1 on the basis of the dock pulse CK from the 
clock generator circuit 4 and then supplied through 
switches SW2. SW3 and SW4 to output terminals TO, 
T1 and T2 and also supplied through switches SW5 
and SW10 to a high-pass filter 16 which will be des- 
cribed later. Incidentally, the switches SW2 to sw4 are 
controlled to opened and/or dosed by a control signal 
SCP from the control pulse generator 21 . On the other 
hand, the respective digital video signals R, G and B 
from the A/D converter 8 are supplied to an AND cir- 
cuit A1 through a switch SI which Is changed in posi- 
tion in response to an R/G/B signal from the control 
pulse generator 21. In this AND circuit A1, the digital 
video signals R, G and B are ANDed with a power 
save signal COMPEN from the control pulse 
generator 21 and which becomes acth^e only in the 
interpolation, and. fed to a interpolating circuit 12 
. which will be explained later. 

When a clock enable signal ckEN from the control 
pulse generator 21 is active, the interpolating circuit 
12 latches pixel data of addresses of upper left, 
above, upper right, left and right of defective pixel on 
the basis of address data of the RAM 25 which stores 
therein the contents stored In the EEPROM 24 in the 
actuation of the apparatus and supplies the latched 
pixel data to a [x - Y| computing device 13 and a 
multplexer 15 which will be referred to below. 

The |x . y| computing device 13 produces an 
absolute values of differences of the respective pixel 
data from the interpolating circuit 12 and supplies the 
same to a comparator 14. The comparator 14 com- 
pares the respective difference signals from the | X - 
Y| computing device 13 and supplies the compared 
result to the multiplexer 15. The multiplexer 15 sup- 
plies, of the respective pixel data from the interpolat- 
ing circuit 12, pixel data corresponding to the 
compared result signal from the comparator 14 to the 
switches SW2, SW3 and SW4 as compensation pixel 
data of defective pixel data. 

Incidentally, the detailed arrangement of the inter- 
polating means including the interpolating circuit 1 2, 
the I X - Y| computing device 13, the comparator 14 
and the multiplexer 15 is substantially similar to that 
of an interpolation infonmation generating means of 
other embodiment which will be described later in 
detail with reference to Fig, 11. 

These switches SW2, SW3 and SW4 are 
switched by the switching signal SCP from the control 
pulse generator 21, whereby the video signals in 
which the defective pixels are corrected are supplied 



9 



EP 0 440 563 A2 



10 



to the terminals TO, T1 and T2 and also supplied 
through the switches SW5 and SW1 0 to the high-pass 
filter 16 that will be described in later stage. 

The innage pickup mode for detecting the defec- 
tive pixel will be explained next The video Image 
mode for detecting a defective pixel is effected as fol- 
lows: When the power switch of the solid state imager 
Is turned ON and when the user supplies a video sig- 
nal bf, for example, the solid state imager to a monitor 
receiver and founds out a blemish In a picture dis- 
played on a picture screen of the monitor receiver, the 
use operates the operation section 29 in accordance 
with the display on the display section 28 and selects 
the image pickup mode for detecting the defective 
pixel. In that case, a white blemish Is detected first. In 
any of the above-mentioned cases, a switch change- 
over signal HPFSSECT from the control pulse 
generator 21 controls the switching operation of the 
switch SW5 to select any of the video signals R, G and 
B from the three solid state image pickup elements. 
Inckjentally, the switch change-over signal 

' HPPSELECT may be input by, for example, the user. 

The^^'iris drive signal CP from the control pulse 
generator 21 is supplied to an iris driving means (not 
shown) of the image pickup optical system 1 and 
close the iris and the control pulse generator 21 gen- 

^ erates a black/white blemish switching signal B/W. 
Generally, it is known that most of blemish occurred 
after the delivery of the solid state imager from the fac- 
tory is white blemish. In the self-test mode after the 
apparatus is actuated, the detection of black blemish 
is not detected, whereas In the Image pickup mode for 
detecting the defective pixel, the detection of white 
blemish Is perfomned after the iris is closed. When the 
white blemish Is not detected, the user is instructed 
such that a white diffusion plate illuminated, for 
example, with an illumination light Is displayed on the 
display section 28, thereby the detection of black 
blemish being effected. 

The high-pass filter 16. a clipping circuit 17 and a 
peak hold circuit 18 used in the aforenoted mode will 
be explained hereinafter, and initially, the high-pass 
filter 16 will be explained. 

The video signal stored In the EEPROM 24 and 
in which the portion of defective pixel is con-ected is 
supplied to the high- pass fitter 16 via the switch SW10 
which is turned ON by a detection enable signal 
HPFEN supplied from the control pulse generator 21 
and which becomes active during, for example, one 
frame period under the control of the microcomputer 
23 when the apparatus is actuated and when the 
image pickup mode for detecting the defective pixel is 
selected by the user by operating the operation sec- 
tion 29. The high-pass filter 16 is a digital fitter com- 
posed of three D-type fiip-flops 16a, 6b. 16c and two 
adding circuits 16d, 16e and is what might be catted 
a Laplacian filter of the horizontal direction. 

A digital video signal applied to a data input ter- 



minal D of the D-type flip-flop 16a is output from a non- 
inverting output tenmtnal Q thereof and fed to a data 
5 input terminal D of the next D-type flip-flop (hereinaf- 
ter simply referred to as a flip-flop) 16b. The outuput 
from a non-inverting output terminal Q of the flip-flop 
16b is supplied to a data input tenmlnal D of the next 
flip-flop 16c. On the other hand, a digital video signal 

10 from an inverting Input terminal Q of the flip-flop 16a 
is supplied to he adder 16d, In which it is added with 
a_digital video signal from an inverting input terminal 
Q of the flip-flop 16c. An output signal from the adder 
16d is supplied to the adder 16e, in which the output 

15 signal from the adder 16d and a digital video signal 
from a non-inverting input terminal Q of the flip-flop 
16b are added to produce a digital video signal fit- 
tered-out by a characteristic of -z-* + 22P - z^ that Is, 
a characteristic In which a peak exists at a frequency 

20 of the portion corresponding to a defective pixel in the 
digital video signal and from which DC and low fre- 
quency components are removed. 

The clipping circuit 17 will be explained. The digi- 
tal video signal from the high-pass filter 16 is supplied 

25 to the clipping circuit 17. Thecltpping circuit 17 is com- 
prised of a flip-flop 17a. a clipper 17b and a switch 
SW6 connecting the flip-flop 17a and the clipper 17b 
and which switchs and supplies at non-inverting and 
inverting output terminals Q and Q of the flip-flop 17a 

30 to the clipper 17b. Since the movable contact of the 
switch SW6 Is switched to a fixed contact connected 
to the non-inverting input terminal Q of the flip-flop 17a 
when the black/white blemish switching signal B/W 
from the control pulse generator 21 Is, for example, 

35 the digital video signal supplied to the flip-flop 17a 

is supplied to the clipper 1 7b via the switch SW6. This 
digital video signal clipped by the clipper 17b is then 
fed to the peak hold circuit 18 which will be described 
below. 

40 The peak hold circuit 18 and the line counter 19 

and the cell counter 20, each of which are indispens- 
able for the peak hold circuit 18 will be explained 
herein. The 10-bit synchronizing type cell counter 20 
is reset by the reference sync, signal supplied to its 

45 reset terminal from the sync, generator 5a and counts 
the clock from the clock generating circuit 4. The 
count value of the cell counter 20 Is fed to the peak 
hold circuit 18, which will be referred to later, and to 
the control putse generator 21. The count values of 

50 the cell counter 20 respectively correspond to addres- 
ses of the solid state image pickup element in the hori- 
zontal direction. When counting one horizontal period 
of the reference horizontal sync, signal, the cell 
counter 20 supplies a carry pulse to the line counter 

55 19. The 9-bit synchronizing type line counter 1 9 is 
reset by the reference vertical sync, signal supplied to 
its reset terminal from the sync, generator 5a and 
counts the clock ck from the clock generating circuit 
4 in response to each carry pulse from the cell cou nter 
20. The count value of the line counter 19 is supplied 
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to the peak hold circuit 18 which will be described later 
and to the control puJse generator 21. The count 
values of the line counter 19 respectively correspond s 
to addresses of the solid state image pickup element 
In the vertical direction. 

Refemng back to the peak hold circuit 18. the 
peak hold circuft 18 is composed of a comparator 18a 
for comparing the present and past digital video sig- io 
nals, a flip-flop 18b for storing an absolute value of 
level of the past digital video signal, a 10-bit flip-nop 
18d for storing a horizontal address of a defective 
pixel, a 9-bit flip-flop 18c for storing a vertical address 
of the defective pixel and switches SW7, SW8 and is 
SW9, 

The digital video signal from the dipping circuit 17 
is supplied to a non-inverting input terminal of the 
comparator 18a and to an input terminal D of the flip- 
flop 18b, respectively, because the switches SW7, 20 
SW8 and SW9 are connected in the illustrated state 
in the nonmal state, or when the peak level provided 
by the defective pixel is not detected. Accordingly, the 
present digital video signal and the past digital video 
signal are compared with each other. When the com- 25 
parator 18a detects the peak level, by the output sig- 
nal of the comparator 18a, the switches SWT, SW8 
and SW9 are connected to the states opposite to the 
illustrated states, whereby the content indicating the 
level of the register of the flip-flop 18b and contents 30 
of horizontal and vertical addresses of registers of the 
flip-flops 18d and 18c are rewritten. Rewritten data 
from the flip-flops 18b, 18d and ISc are supplied 
through a bus (formed of address bus, data bus and 
control bus) Bu to the microcomputer 23, stored in the 35 
RAM 25 as new data and further stored in the EEP- 
ROM 24 as backup data. Incidentally, the respective 
flip-flops 18b, 18c and 18d are reset by a reset signal 
PEAKCLR supplied thereto from the control pulse 
generator 21 when the apparatus is actuated. 40 

A description will be next given on a method in 
which a video signal, which results from closing the 
iris of the solid state imager or picking up, for example, 
a white diffusion plate (it is assumed that the white dif- 
fusion plate be illuminated by a niumination light from 45 
the direction opposite to the image pickup direction), 
is supplied to a monitor receiver, such video signal is 
displayed on the picture screen of the monitor 
receiver and the user of the solid state imager regis- 
ters a position of new blemish other than those regis- 50 
tered beforehand, that is, the defective pixel 
designating mode. 

Incidentally, the registration of the position of the 
defective pixel will be understood as follows : When a 
defective pixel cannot be detected by the above-men- 55 
tiond solid state imager in the self-test mode and in the 
image pickup mode for detecting the defective pixel, 
the video signal from the solid state imager is supplied 
to the monitor receiver and the user visually confinns 
a picture displayed on the picture screen of the moni- 



tor receiver (i.e., a black picture displayed when the 
iris is dosed or a white picture displayed when the 
white diffusion plate is picked up). Then, the user 
moves a marker of, for example, a cross shape dis- 
played on an arbitrary posiUon on the picture screen 
of the monitor receiver to the position of a new blemish 
visually cpnfimned by operating a marker controller 
27, which will be refenred to later, of the solid state 
imager, and the position mari^ed by the cross-shaped 
marker is stored in the RAM 25 and the EEPROM 24 
of the solid state imager as the position of the defec- 
tive pixel. In this defective pixel designating mode, a 
video signal provided before or after the interpolation 
processing based on defective pixel data already 
stored in the EEPROM 24 or the RAM 24 prior to the 
selection of this mode can be selected. 

The mariner controller 27 has, for example, a cur- 
sor key, and if the user pushes the cursor key. 
address data indicating the position of the cursor is 
increased and/or decreased during the depression of 
the cursor key. The address data is always supplied 
to a markergenerator 26 which will be explained next. 
The marker generator 26 supplies data stored, for 
example, in an incorporated ROM and which Indicates 
a cross-shaped mariner whose width corresponds to 
one pixel through the switches SW2, SW3 and SW4 
to the output tenminals TO. T1 and T2 only when the 
address data from the marker controller 27 coinddes 
with the address data supplied thereto via the bus Bu 
from the line counter 19 and the cell counter 20. When 
the user moves the cross-shaped mariner to the posi- 
tion of the blemish to be newly registered by the cursor 
key and the cross-shaped marker exists on the posi- 
tion of blemish to be registered, if the user pushes, for 
example, the button, address data indicating the pre- 
sent position of the cross-shaped mariner and a write 
control signal are supplied from the marker controller 
27 through the marker generator 26 and the bus Bu 
to the RAM 25 and the microcomputer 23. Further, the 
white blemish or the black blemish is selected by the 
user by pushing a button or the like. The microconv 
puter 23 controls a RAM controller 22, which will be 
refen-ed to later, via the bus Bu so that the address 
data from the maricer controller 27 and the content of 
defective pixel designated by the user(content indi- 
cating whether the blemish is white blemish or black 
blemish) are written in the RAM 25. 

Of the above-mentioned three modes, the image 
pickup mode for detecting the defective pixel will be 
explained with reference to a flowchart forming Fig. 4, 
in which case, the user perfonns several designatio ns 
directly. 

Refening to Fig. 4. following the Start of oper- 
ation, it is determined in decision step ST-1 whether 
or not the user inputs data indicating the occun-ence 
of blemish, that is. the user inputs data to select the 
image pickup mode for detecting a defective pixel- If 
a YES is output at decision step ST-1, then the pro- 
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cessing proceeds to the next decision step ST-2, and 
if a NO is output at step ST-1, then the processing 
returns to step ST-1 whereat the apparatus awaits the 
data input by the user, or the apparatus is set in the 
normal inr>age pickup nnode. 

It is determined in decision step ST-2 whether or 
not'th'e channel input. I.e., the digital video signals R, 
G and B from the three image pickup elements are 
selected. If a YES Is output at step ST-2, then the pro- 
cessing proceeds to the next decision step ST-3. If a 
NO is output at step ST-2, then the processing returns 
to step ST-2 and step ST-2 Is repeated. In-step ST-2, 
daM indicative of channel may be input by the user or 
the digital video signals R, G and B may be automati- 
cally selected in that order. 

In step ST-3, it is determined whether the blemish 
is the white blemish or not If a YES is output at step 
ST-3, the processing proceeds to step ST-4, and if a 
NO is output at step ST-3, then the processing pro- 
ceeds to the next decision step ST-5, In the step ST-4. 
the iris is closed and the processing proceeds to step 

st^t; 

' It is determined in step ST-5 whether or not the 
blemish Is the black blemish. If a YES is output at step 
ST-5, then a processing proceeds to step ST-6, and 
if a NO is output at step ST-5, then the processing 
returns to step step ST-3. whereat it Is determined 
whether or not the blemish Is the white blemish. 
Whether or not the blemish is the white blemish or the 
black blemish may be input by the user and alterna- 
tively, such determination may be automatically per- 
formed by the output state from the high-pass filter 1 6. 

In step ST-6, the user is instructed to pick up a 
white pattern which Instructions displayed on the dis- 
play section 28 which is described with reference to 
Fig. 3. and then the processing proceeds to the next 
step ST-7. 

In step ST-7. the blemish Is measured, and then 
the processing proceeds to the next decision step ST- 
8. 

It Is detemiined in step ST-8 on the basis of 
address data from the line counter ig and the cell 
counter 20 shown in Fig. 3 whether or not the scan- 
ning of one frame period is finished. If a YES is output 
at step ST-8, then the processing proceeds to step 
ST-9. If a NO is output at step ST-8, then the proces- 
sing returns to step ST-7, whereat the blemish is 
measured. 

In step ST-9. blemish data is written In the RAM 
25 and the EEPROM 24, and then the processing pro- 
ceeds to the next decision step ST-10. 

It Is determined at decisk>n step ST-1 0 whether or 
not the user confirms the blemish data by the display 
on the display section 28 shown In Fig. 3. If a YES Is 
output at step ST-10. then the processing is ended, 
and if a NO is output at step ST-10, then the proces- 
sing returns to step ST-1 . and step ST-1 and so on are 
repeated again. 
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Of the above-mentioned three modes, the mode 
that the user need not designate directly other than 
5 the image pickup mode for detecting the defective 
pixel will be explained briefly with reference to a flow- 
chart forming Fig. 5. 

Referring to Fig. 5, following the Start of oper- 
ation, it is determined in decision step ST-1 whether 
10 or not the user input the data indicative of the occurr- 
ence of blemish, that is, whether or not the camera 
mode for detecting the defective pixel is selected. If a 
YES is output at step ST-1, then the processing pro- 
ceeds to the next decision step ST-2, an if a NO is ou t- 
is put at step ST-1 , then the apparahjs Is set in the mode 
to await that input, namely, the normal camera mode. 

It is determined In decision step ST-2 whether or 
not the detection of the blemish of the digital video sig- 
nal R is finished. If a YES is output at step ST-2, then 
20 the processing proceeds to the next decision step ST- 
4 and if a NO is output at step ST-2, then the proces- 
sing proceeds to step ST-3. 

In step ST-3, the switch change-over signals 
HPFSELECT from the control pulse generator 21 
25 shown in Fig. 3 is supplied to the switch SW5 to 
thereby select the digital video signal R. and then the 
processing proceeds to step ST-€. 

In step ST-4. it is determined whether or not the 
detection of the blemish of the digital video signal G 
30 Is finished. If a YES is output at step ST-4. then the 
processing proceeds to the next decision step ST-6, 
and if a NO is output at step ST-6, then the processing 
proceeds to step ST-5. 

In step ST-5, the switch change-over signal : 
35 HPFSELECT from the control pulse generator 21 
shown In Fig. 3 Is supplied to the switch SW5 to 
thereby select the digital video signal G. and the pro- 
cessing proceeds to step ST-8. 

It is determined In decisk)n step ST-6 whether the 
40 detection of the blemish of the digital video signal B 
is finished or not. If a YES is output at step ST-6, then 
the processing Is ended, and if a NO Is output at step 
ST-6, then the processing proceeds to step ST-7. 
In step ST-7. the switch change-over signal 
45 HPFSELECT from the control pulse generator 21 
shown In Fig. 3 Is supplied to the switch SW5 to 
thereby select the digital video signal B. and then the 
processing proceeds to the next step ST-B. 

In the next step ST-8. the iris is closed and then 
50 the processing proceeds to step ST-9. In step ST-9. 
the blemish is measured and the processing pro- 
ceeds to the next decision step ST-10. 

It is detenmined In decision step ST-10 by the 
address data from the line counter 19 and the cell 
55 counter 20 shown in Fig. 3 whether or not the scan- 
ning of one frame is finished. If a YES Is output at step 
ST-10. then the processing proceeds to the next deci- 
sion step ST-1 1 . If a NO is output at step ST-1 0, then 
the processing returns to step ST-9, whereat the 
measurement of the blemish is continued. 

9 
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It is determined in decision step ST-1 1 whether or 
not the blemish is detected. If a YES is output at step 
ST-11, then the processing proceeds to step ST-1 2, 
and if a NO is output at step ST-1 1. then the proces- 
sing proceed to the next decision step ST-1 3. 

In step ST-1 2, blemish data is written in the RAM 
25 and the EEPROM 24 shown in Fig. 3 and. the pro- 
cessing proceeds to the next decision step ST-1 3. 

In step ST-1 3, it is detennined whether the detec- 
tion of black blemish is finished or not. If a YES is out- 
put at step ST-1 3, then the processing returns to step 
ST-2, and if a NO is output at step ST-1 3. then the pro- 
cessing proceeds to step ST-1 4. 

In step ST-14, an instruction is displayed on the 
display portion 28 shown in Fig. 3, for the user to pick 
up a white pattern. Then, the processing returns to 
step ST-9, whereat the black blemish is detected. 

Of the above-mentioned three modes, the self- 
test mode can-ied out when the power switch of the 
apparatus is turned on will be described in brief with 
reference to a flowchart of Fig. 6. Incidentally, in this 
self-test mode, the detection operation for automati- 
cally detecting a white blemish when the apparatus is 
actuated will be described below. 

Refening to Fig. 6, following the Start of oper- 
ation. In step ST-1, the solid state imager Is powered, 
and then the processing proceeds to the next decision 
step ST-2. 

It is determined in decision step ST-2 whether the 
detection of blemish of the digital video signal R is 
finished or not. If a YES is output at step ST-2, then 
the processing proceeds to the next decision step ST- 
4 and If a NO is output at step ST-2, then the proces- 
sing proceeds to step ST-3. 

In step ST-3, the switch change-over signal 
HPFSELECT from the control pulse generator 21 
shown in Fig. 3 is supplied to the switch SW5 which 
then selects the digital video signal R, and the proces- 
sing proceeds to step ST-8. 

It is determined In decision step ST-4 whether or 
not the detection of blemish of the digital video signal 
G is finished. If a YES is output at step ST-4, then the 
processing proceeds to the next decision step ST-6, 
and if a NO is output at step ST-4, then the processing 
proceeds to step ST-5. 

In step ST-5, the switch change-over signal 
HPFSELECT from the control pulse generator 21 
shown in Fig. 3 is supplied to the switch SW5 which 
then selects the digital video signal G, and then the 
processing proceeds to step ST-8. 

It is determined in decision step ST-6 whether the 
detection of blemish of the digital video signal B is 
finished or not. If a YES is output at step ST-6, then 
the processing proceeds to the final step ST-1 3, and 
if a NO is output at step ST-6, then the processing pro- 
ceeds to the next step ST-7. 

In step ST-7, the switch change-over signal 
HPFSELECT from the control pulse generator 21 



shown in Fig. 3 is supplied to the switch SW5 which 
then selects the digital video signal B, and then the 
5 processing proceeds to step ST-8. 

In step ST-8, the iris is closed and the processing 
proceeds to step ST-9. 

In step ST-9, the flemish is measured and the pro- 
cessing proceed to the next step ST-1 0. 
10 It is determined in decision step ST-10 on the 

basis of the address data from the line counter 19 and 
the cell counter 20 shown In Fig. 3 whether or not the 
scanning of one frame Is finished. If a YES is output 
at step ST-10, then the processing proceeds to the 
IS next decision step ST-1 1 , and if a NO is output at step 
ST-10, then the processing returns to step ST-9, 
whereat the measurement of blemish is continued. 

It is determined in decision step ST-1 1 whether or 
not the blemish is detected. If a YES is output at step 
20 ST-11, then the processing proceeds to step ST-1 2, 
and if a NO Is output at step ST-11, then the proces- 
sing returns to step ST-2, and the step ST-2 and the 
following steps are repeated. 

In step ST-1 2, blemish data detected is written In 
25 the EEPROM 24 shown in Fig. 3 and then the proces- 
sing returns again to the step ST-2- 

fn the final step ST-1 3, data stored in the EEP- 
ROM 24 is loaded to the RAM 25 shown in Fig. 3 and 
the processing Is ended. 
30 Of the above-mentioned three modes, the defec- 

tive pixel designating mode be described briefly with 
reference to a flowchart forming Flg.7. 

Refem'ng to Fig.7, following the start of operation, 
in step ST-1, when the user designates this mode by 
35 using the operation unit 29 shown in Fig.3. the cross- 
shaped maricer generated from the mariner generator 
26 shown in Fig.3 is displayed at an arbitrary position 
of the picture screen of the monitor receiver to which 
the output video signal from the solid state image 
40 pickup apparatus is supplied. Then, the processing 
proceeds to the next decision step ST-2, 

It is determined in step ST-2 by the user by 
operating the marker controller 27 shown in Fig. 3 
whether or not the position command from the marker 
45 controller 27, or the address data exists. If a YES is 
output at step ST-2, then the processing proceeds to 
the next step ST-3 and If a NO Is output at step ST-2, 
the apparatus is placed In the standby mode for the 
input. 

50 In step ST-3, each time the user operates the 

mariner controller 27, the address of the cross-shaped 
mariner is updated by the maricer generator 26 and the 
cross-shaped marf<er is moved on the picture screen 
of the monitor receiver. Then, the processing pro- 

55 ceeds to the next decision step ST-4. 

In step ST-4, when the user pushes a button or 
the like after the position of the cross-shaped marker 
is made coincident with the position of the blemish dis- 
covered on the picture screen of the nxjnitor receiver 
by the user, address data supplied from the marker 

10 
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controller 27 at that time is stored. Then, it is deter- 
mined whether or not the button is pushed. If a YES 
Is output at step ST-4, the processing proceeds to 
step ST-5 and if a NO Is output at step ST-4. then the 
processing returns to step ST-2. 

In step ST-5. the address data supplied from the 
markW controller 27 (s stored In the RAM 25 and the 
EEPRpM 24 shown in Fig. 3 as the data of the flemish 
pixel^ 'and then the processing proceeds to the next 
decision step ST-6. 

Iri step ST-6, a message Indicating whether or not 
the defective pixel designating mode is released is 
displayed on the display section 28 shown in Fig. 3 for 
the user and it is determined whether or not the 
release of the defective pixel designating mode is 
selected by the user by operating the operation sec- 
tion 29. If a YES is output at step ST-6, then the pro- 
cessing is ended and if a NO is output at step ST-6. 
then the processing returns to step ST-T. 

In the solid state imager provided with the above- 
mentioned image defect correcting circuit, three 
' modirs are available. In the normal camera mode, the 
defective pixel is interpolated on the basis of the data 
store^d beforehand in the EEPROM 24 ; in the camera 
mode for detecting the defective pixel, not only the 
inspection of the blenriish before the solid state imager 
Is bo%ht by the user can be considerably simplified 
but also data can be additionally provided to the data 
stored beforehand In the EEPROM 24. Particulariy, in 
the setf-test mode which needs no input by the user 
when the solid state imager is switched ON. the detec- 
tion and interpolation of the defective pixel can be 
automatically carried out when the solid state imager 
is powered. Further, In the defetive pixel designating 
mode, data indicative of blemish visually discovered 
by the user can be stored in the EEPROM 24. 
whereby minute white blemish and black blemish also 
can be interpdiated. 

In the description of Fig. 3, the image defect cor- 
recting circuit in the solid state imager may be pro- 
vided inside or outside the solid state imager. Further, 
the microcomputer 23 may be replaced with, for 
example, a personal computer and this personal com- 
puter may be connected via, for example, RS-232C 
interface to the solid state imager In that event, the 
EEPROM 24 may be a floppy disk, a magneto-optical 
disc or the like when an external storage apparatus is 
utilized. Furthermore, the above-mentioned image 
defect correcting circuit can be fabricated as an IC 
with ease. 

According to the above embodiment of the pre- 
sent invention, an image defect correcting circuit for 
a solid state imager is comprised of comparing means 
for comparing levels of output signals from respective 
pixels of a solid state image pickup element illumi- 
nated on its whole surface with a light of uniform 
brightness with a predetermined level, position data 
generating means for generating data indicative of a 



position of pixel which outputs a signal of peculiar 
level on the basis of the compared result of said com- 

5 paring means, interpolating means for interpolating 
an output signal output from the pixel located at the 
position indicated by the position data generated from 
at least the position data generating means by using 
an output signal derived from other pbcel. and swltch- 

10 ing means for selectively switching the output signals 
of the respective pixels and an output signal of the 
interpolating means on the basis of the output signal 
from the position data generating means. Therefore, 
even when blemish occurs in the solid state image 

15 pickup element housed in the housing, the blemish 
occurred in the solid state image ptekup element can 
be interpolated without disassembling the solid state 
image pickup element from the housing. 
A second embodiment according to the present will 

20 hereinafter be described with reference to Figs. 9 to 
17. 

In the second embodiment shown in Figs. 9 to 17. 
the present invention is applied to a signal processing 
system of a so-called three plate-type solid state 

25 Image pickup apparatus in which a color image is 
picked up by three solid state image sensors 51 R, 
51 G and 51 B on which image pickup screens there 
are focused object images analyzed in color into red, 
green and blue three primary colors by an image 

30 pickup optical system for image light- 
As shown in Fig. 9, in the signal processing sys- 
tem of this solid state image pickup apparatus, a red 
camera output signal from the solid state image sen- 
sor 51 R for picking up a red image is supplied through 

35 a pre-amplifier 52R to an A/D converter 53R, and is 
thereby converted to a 10-bit digitized red camera 
data Dr. which is then fed to a first input terminal 61 R 
of an image defect correcting circuit 60 according to 
the present invention. A green camera output signal 

40 from a solid state image sensor 51 0 for picking up a 
green image Is supplied through a pre-amplifter 52G 
to an A/D converter 53G, and Is thereby converted to 
a 10-blt green camera data Dq, which Is then fed to a 
second input tenminal 61G of the image defect cor- 

45 reeling circuit 60. Further, a blue camera output signal 
from a solid state image sensor 51B for picking up a 
blue image is supplied through a pre-amplifier 52B to 
an A/D converter 53B. and is thereby converted into 
a 10-bit blue image data Db, which is then fed to a third 

50 input terminal 61B of the image defect correcting cir- 
cuit 60. 

As the above-mentioned solid state image sen- 
sor, there is utilized a CCD image sensor of an Inter- 
line transfer type which comprises as, for example, 
55 shown in Fig. 10, a numberof light receiving sections 
S corresponding to respective pixels arrayed in a mat- 
rix-fashion, vertical transfer registers VR provided at 
one side of these light receiving sections S along the 
longitudinal direction and a horizontal transfer register 
HR provided at the ends of these vertical transfer regl- 
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sters VR. whereby signal charges obtained from the 
respective light receiving sections S in response to 
the light receiving amount are transfen-ed to respec-. 5 
tive corresponding vertical transfer registers VR at, for 
example, every one field or at every one frame, the 
above-mentioned signar charges are transferred to 
the horizontal register HR through the vertical transfer 
registers VR and a signal charge from the horizontal lo 
transfer register HR at every horizontal line is gener- 
ated as an image pickup output 

Turning back to Fig.9, the image defect correcting 
circuit 60 of this embodiment is comprised of an inter- 
polation information generating circuit 63 to which is 
there are supplied the three primary color image 
pickup data Or, Dq and Dg from the first to third input 
temiinals 61R, 61G and 61B through a first channel 
selection switch 62, a first substitute switch 65R to 
which an interpolation information fonned by the inter- 20 
polation Information generating circuit 63 is supplied 
and to which the red camera data Dr is supplied from 
the first input tenninal 61 R through a delay circuit 64R, 
a second substitute switch 65G to which the interpo- 
lation information generated by the interpolation Infer- 25 
mation generating circuit 63 Is supplied and to which 
the green camera data Dq is supplied from the second 
Input temiinaieiG through a delay circuit 64G,.a third 
substitute switch 65B to which the interpotion signal 
is supplied from the circuit 63 and to which the blue 30 
camera data Db Is supplied from the third input termi- 
nal 61 B through a delay circuit 64B. a defect position 
detecting circuit 67 lo which output data from the first 
to third substitute switches 65R, 65G and 65B are 
supplied through a second channel selection switch 35 
66. a system controller 68 for controlling operations of 
the above-mentioned elements, a memory 69, a line 
address counter 70 and pixel address counter 71 
which are connected to the above system controller 
68 and so on. 40 

The interpolation information generating circuit 
63 is comprised of, as shown by a specific arrange- 
ment in Fig. 11, a register section 80 which tempor- 
arily stores camera data of channel selected by the 
first channel selection switch 62. an absolute value 45 
computing section 90 which calculates an absolute 
value of level difference between signal levels indi- 
cated by the camera data stored temporarily in the 
register section 80, a comparing section 1 00 for con> 
paring respective absolute values calculated by this so 
absolute value computing section 90 and an interpo- 
lation operaion section 1 1 0 for obtaining a video infor- 
mation at the position of the defective pixel by 
selectively Interpolating camera data stored in the 
register section 80 on the basis of the compared result ss 
by the comparing section 100. 

The register section 80 is composed of first to 
third D flip-flops 81. 82 and 83 connected in cascade, 
fourth to sixth D flip-flops 84. 85 and 86 connected in 
cascade and input change-over switches 87, 88 and 



89 for changing-over inputs of the first to third D flip- 
flops 81,82 and 83. 

In the register section 80, the first D flip-flop 81 
latches camera data of 10 bits supplied to its data 
input terminal D through the input change-over switch 
87 from the first channel selection switch 62 and feeds 
its Q output back to the data input terminal D thereof 
through the input change-over switch 87 to thereby 
temporarily store the latched data. The second D flip- 
flop 82 stores the Q output of first flip-flop 81 supplied 
to its data input terminal D through the input change- 
over switch 88 and feeds the Q output thereof back to 
the data input terminal D thereof through the input 
change-over switch 88 to thereby temporarily store 
the latched camera data. Further, the third D flip-flop 
83 latches the Q output of the second D flip-flop 82 
supplied to its data input tenninal D through the input 
change-over switch 89 and feeds the Q output thereof 
back to the data input tenminal thereof through the 
input change-over switch 89 to thereby temporarily 
store the latched camera data. In this register section 
80, the above input change-over switches 87, 88 and 
89 are controlled by the system controller 68, whereby 
the first to thrid D flip-flops 81. 82 and 83 latches cam- 
era output Dc, Db, Da from three nearby pixels c. b. 
a located one horizontal line before the defective pixel 
X as shown in Fig. 12 and temporarily store the res- 
pective camera output data Dc, Db, Da, 

The first D flip-flop 81 supplies the above-men- 
tioned absolute value operation section 90 with upper 
signiflcant 8-bit data of the camera output data Dc 
from the pixel c obtained as the Q output thereof. The 
second D flip-flop 82 supplies the above-mentioned 
interpolation operation section 110 with the camera 
output data Db from the pixel b obtained as the Q out- 
put thereof and also supplies the absolute value oper- 
ation section 90 with polarity inverted data Db of the 
camera output data Db obtained as the Q output 
thereof. Further, the third D flip-flop 83 supplies the 
absolute value operation section 90 with upper signifi- 
cant 8-bit data of the camera output data Da from the 
pixel a obtained as the Q output thereof. 

Further, in this register sectton 80, the fourth to 
sixth D flip-flops 84, 85 and 86 latch in a dot-sequen- 
tial manner the camera data of the channel selected 
by the first channel selection switch 62 and transfer 
the same, and respective upper significant 8-bit data 
of the Q outputs of the fourth and sixth D flip-flops 84 
and 86 are supplied to the absolute value operation 
section 90. Also, the respective Q outputs of the fifth 
and sixth D flip-flops 85 and 86 are supplied to the 
interpolation operation section 110, 

The above-mentioned absolute value operation 
section 90 is composed of first to fourth adders 91 A, 
91B, 91C. 91D. first to fourth exclusive NOR circuits 
92A. 92B, 92C. 92D supplied with added outputs of 
these adders 91 A, 91 B, 91 C. 91 D and first to fourth 
D flip-flops 93A. 93B, 93C, 93D supplied at their data 
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input tenminals D with outputs of these exclusive NOR 
circuits 92A. 92B, 92C, 92D. 

The first adder 91A adds the Q output of the first 5 
D flip-flop 81 and the Q output of the fourth D flip-fiop 
84 in the register section 80. The first exclusive NOR 
circuit 92A exdusrve-NORes the polarity bit S and the 
data bit of the added output from the first adder 91 A. 
and supplies this exclusive-NORed output to the data io 
input terminal D of the first D flip-flop 93A. 

The second adder 91 B adds the Q output of the 
first Dflip-flop 81 and the Q output of the second D flip- 
flop 82 in the register section 80. The second exc- 
lusive-NCR circuit 92B exclusive-NORes the polarity is 
bit S and the data bit of the added output of the second 
adder 91 B, and supplies an exdusive-NORed output 
to the data input temimal D of the second D flip-flop 
93B. _ 

Further, the third adder 91 C adds the Q output of 20 
the second D flip-flop 82 and the Q output of the third 
D flip-flop 83 in the register section 80. The third ex- 
lusfve-NOR circuit 92C exclusive-NORes the polarity 
bit S and'the data bit of the added output of the third 
• adder91C, and supplies this exclusive-NORed output 25 
to the data input terminal D of the third D flip-flop 93C. 

The fourth adder 91 D adds the Q output of the 
third D flip-flop 83 and the Q output of the sixth D flip- 
flop 86in the register section 80. Then, the fourth exc- 
lush/e-NOR circuit 92D exclusive-NORes the polarity 30 
bit S and the data bit of the added output of the fourth 
adder 91 D, and supplies the exclusive-NORed output 
thereof to the data Input temilnal D of the fourth flip- 
flop 930. 

Under the condition such that the fifth D flip-flop as 
65 in the register 80 latches camera output data Dx of 
the defective pixel x shown in Fig. 12, the fourth D flip- 
flop 84 outputs camera output data De from a pixel e 
adjacent to the defective pbcel x and that the sixth flip- 
flop 86 outputs camera output data Dd from the pixel 40 
d adjacent to the above-mentioned defective pixel x, 
the first to fourth D flip-flops 93A, 93B, 93C and 930 
latch absolute value data I Oc - Oe I , I Ob - Oc I , I Oa 
-Obi, I Da - Dd I of differences between camera out- 
put data from the pixels a, b, c, d and e located near 45 
the defective pbcel x obtained as the exclusive-NO- 
Red outputs of the exclusive-NOR circuits 92A, 92B» 
92C and 920. 

The absolute value operation section 90 supplies 
the comparing section 100 with the absolute value so 
data lOc-Del, |Oc-Db|, |0a-0b| and |Oa-Dd| 
latched in flrst to fourth O flip-flops 93A, 938. 93C, and 
930. 

This comparing section 100 is composed of first 
to fourth comparators 101A, 101B, 101C, 1010 to ss 
which the absolute value data I Oc - Oe I , I Dc - Ob I . 
I Oa - Ob I , I Oa - Od I from the absolute value operat- 
ing section 90, a D flip-flop 102 which latches com- 
pared outputs of the flrst to fourth comparators 101 A, 
1 01 B. 1 01 C, 1 01 0 and a decoder 1 03 which decodes 



a latched output from the O flip-flop 102. 

The first comparator 101 A compares the absolute 
value data I Oa - Od I and I Oa - Ob I from the abso- 
lute value operating section 90, and supplies its com- 
pared output to a first data input terminal 01 of the D 
flip-flop 102. The compared output of the first com- 
parator 101 A goes logic (HJ (high) level when | Oa - 
Od I > I Oa - Ob I and goes logic [L] (low) level when 
lOa-OdI < lOa-Dbl. 

The second comparator 10TB compares the 
absolute value data I Oa * Dd I and I Db - Dc I sup- 
plied thereto from the absolute value operating sec- 
tion 90 and supplies its compared output to a second 
data input tenminal 02 of the O flip-flop 102. The conrv 
pared output of this second comparator 102 goes 
logic [H] level when | Oa - Dd I > I Db - Dc | and goes 
logic [L] level when I Oa - Od I < . I Ob - Del . 

Further, the third comparator 102 compares the 
absolute value data I Oc - De | and | Da - Db | sup- 
plied thereto from the absolute value operating sec- 
tion 90 and supplies its compared output to a third 
data input terminal 03 of the 0 flip-flop 102. Theconrv 
pared output of the third comparator 101C goes logic 
[H] level when lOc-Oej > |Oa-Db| and goes logic 
[L] level when I Oc - De | < | Oa - Db I . 

The fourth comparator 1 01 0 compares the abso- 
lute value data lOc-Oel and |Db- Dc| supplied 
thereto from the above absolute value operating sec- 
tion 90 and supplies its compared output to a fourth 
data input terminal D4 of the O flip-flop 102. The com- 
pared output of the fourth comparator 1 01 D goes logic 
[H] level when I Dc - De | > I Db - Dcj and goes logic 
[L] level when |Dc-De| < iOb-Dc| . 

In the comparing section 100, the decoder 103 
decodes the latched outputs Q1, Q2\ 'Q3 and Q4 
obtained from the 0 flip-flop 102 which latches the 
compared outputs of the first to fourth comparators 
101 A, 101B. 101c and 101O In accorxlance with a 
decoding fashion shown in Fig. 13 to thereby gener- 
ate a selection control signal Dc tl- 

The selection control signal Dc t u from the conv 
paring section 100 is supplied to the interpolation 
information selecting section 110. 

It will be seen in Fig, 11 that the interpolation infor- 
mation selecting section 110 Is composed of an adder 

111 which is supplied with the Q output of the fifth O 
flip-flop 85 in the register section 60, a first D flip-flop 

112 which is supplied at its data input tenminal D with 
the Q output of the sixth flip-flop 86 In the register sec- 
tion 80, a second O flip-flop 113 which is supplied at 
its data input tenminal 0 with the Q output of the 1irst 
O flip-flop 112. a third 0 flip-flop 114 which is supplied 
at its data input tenminal D with the added output of the 
adder 1 1 1 , a change-over switch 115 which is control- 
led by the selection control data Dc t l ^^om the conv 
paring section 100 and a fourth 0 flip-flop 116 which 
is supplied at its data input tenminal D with the inter- 
polation output selected by the change-over switch 
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115. 

The adder 1 1 1 adds the Q output of the first D flip- 
flop 112 and the Q output of the fifth D flip-flop 85 in 
the register section 80. 

The change-over switch 1 15 is supplied at its first 
input terminal 11 5A with the add ed output of the adder 
111 through the third D flip-flop 114. The data sup- 
plied to the first input tenminal 1 15A is output through 
the fourth D flip-flop 1 16 as mean value interpolation 
data Da v which is provided as 



by using camera output data Dd and De provided by 
the two pixels d and e adjacent to the above-men- 
tioned defective pixel x. 

The change-over switch 1 15 Is supplied at its sec- 
ond input terminal 115B with the Q output of the first 
D flip-flop 1 12 through the second D flip-flop 1 13. The 
data supplied to the second input terminal 1 15B of the 
Chang e-over switch 11 5 is output through the fourth D 
flip-flop 1 1 6 as 0-order hold interpolation data utilizing 
the camera output data provided by the pixel d located 
adjacent to the at>ove defective pixel x. 

The change-over switch 1 15 is supplied at Its third 
input tenminal 1 15C with the Q output of the sixth flip- 
flop 86 in the register section 80. The data supplied to 
the third input terminal 11 5C of the change-over 
switch 1 1 5 is output through the fourth D flip-flop 1 1 6 
as 0-order hold interpolation data utilizing the camera 
output data De provided by the pixel e located adja- 
cent to the above defective pixel x. 

Furthemiore, the change-over switch 115 is sup- 
plied at its fourth input terminal 1 1 5D with the Q output 
of the second D flip-flop 82 in the register section 80. 
The data supplied to the fourth input terminal 1 1 5D of 
the change-over switch 115 Is output through the 
fourth D flip-flop 116 as 0-order hold interpolation data 
utilizing the camera output data Db provided by the 
pb<el b located one horizontal line before the above- 
described defective pixel x. 

In the thus arranged interpolation information 
generating circuit 63, when an object image picked up 
by the pixels a, b, c, d, e located near the defective 
pUel x is a stripe pattern extending in the horizontal 
direction as shown in Figs. 14A and 14B, the interpo- 
lation information selecting section 110 is controlled 
such that the change-over switch 115 is connected to 
the first input tenminal 115A by the selection control 
signal Mn derived from the decoder 103 of the com- 
paring section 100, thereby the mean value interpo- 
lation data Da v provided by the camera output data 
Dd and De from the two pixels d and e adjacent to the 
defective pixel x being output as conrection data of the 
camera output data Dx of the defective pixel x. 

When an object image picked up by the respec- 
tive pixels a, b, c. d and e is a stripe pattern which is 
oriented upper left as shown in Figs. 15A. 15B and 



15C. the interpolation information selecting section 
110 is controlled such that the change-over switch 
5 1 15 is connected to the second input terminal 1 1 5B by 
the selection control signal Ml derived from the 
decoder 103 of the comparing section 100, thereby 
the camera output data Dd provided by the pixel d 
located adjacent to the defective pbcel x being output 
10 as correction data of the camera output data Dx of the 
defective pixel x. 

Further, when an object image picked up the res- 
pective pixels a, b, c, d and e Is a stripe pattern which 
is oriented in the upper right as shown in Figs. 16A, 
rs 16B and 16C, the above-mentioned interpolation 
information selecting section 110 is controlled such 
that the change-over switch 115 is connected to the 
third input temiinal 115C by the selection control sig- 
nal Mr derived from the decoder 103 of the comparing 
20 section 100, thereby the camera output data Do pro- 
vided by the pixel e located adjacent to the defective 
pixel X being output as con-ection data of the camera 
output data Dx of the defective pixel x. 

Furthennore, when an object image picked up by 
25 the respective pixels a. b, c, d and e located near the 
defective pixel x Is a stripe pattern which Is oriented 
in the vertical direction as shown in Figs. 17A and 
178, the interpolation informatton selecting section 
110 is controlled such that the change-over switch 
30 115 is connected to the fourth input tenminal 1 15D by 
the selection control signal My derived from the 
decoder 103 of the comparing sectkin 100, thereby 
the camera output data Db provided by the pixel b 
located one horizontal line before the defective pbcel 
35 X being output as correcUon data of the camera output 
data Dx of the defective pixel x, 

In the image defect correcting circuit 60 of this 
embodiment shown in Fig.9, the first channel selec- 
tion switch 62 is controlled by the system controller 68 
40 in such a fashion that defective pixel position data 
Indicative of positions of defective pixels Involved in 
the respective solid state image sensors 51R, 51 G 
and 51 B are read out of the memory 69 together with 
the identifying data of the respective solid state image 
45 sensors 51 R, 51 G, and 51 B and camera output data 
of channel including the camera output data Dx of the 
defective pixel x is selectively supplied to the interpo- 
lation information generating circuit 63. Also, the first 
to third substitute switches 65R, 65G and 65B are 
50 selectively controlled such that the camera output 
data Dx provided by the defective pixel x is replaced 
with the interpolation data D generated by the interpo- 
lation information generating circuit 63. 

Incidentally, the positions of the defective pixels 
55 involved in these solid state image sensors 51 R, 5 1 G 
and 51 B are detected beforehand by the defective 
pixel detecting section 67 to which the camera output 
data Dr, Do and Db from the solid state image senso rs 
51 R, 51 G and 518 are supplied through the second 
channel selection switch 66, and tfie defective pixel 
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position data are stored in the above-mentioned 
memory 69 together with identifying data of the solid 
state image sensors 51 R» 51 G and 51 B. 

Fig. 18 shows in block fomrt a specific an-ange- 
ment of the defective pixel detecting section 67. As 
shown in Ftg. 18, the defective pixel detecting section 
67 is-generally composed of a high-pass filter section 
120,% clipping processing section 130 and a defective 
position detection processing section 140. 

The high-pass filter section 120 Is comprised of D 
flip-flops 121 » 122 and 123 of three stages and two 
adders 124 and 125, a D flip-flop 128 at output stage, 
and a switch 127 to thereby derive transfer function H 
(z) expressed as 

H(z) = -zj^ +2zO-z^ 
Q output and Q output of the D flip-flop 126 at the out- 
put stage can be selectively output by way of the 
switch 127. This switch 127 is controlled by the above- 
mentioned systenn controller 68 so as to select the Q 
output when the defect of white blemish is detected 
and to select the Q output when the defect of black 
' bleniish is detected. 

The image data whose DC component and 
whose low band component are eliminated by the 
high-pass Alter section 120 is clipped in its negative 
side by the dipping processing section 130 and fed to 
the dbfect position detection processing section 140. 

As shown in Fig. 1 8, the defect position detection 
processing section 140 is composed of a first D flip- 
flop 141 which temporarily stores image data supplied 
from the clipping processing section 130, a second D 
flip-flop 142 which temporarily stores line address 
data supplied from the line address counter 70, a third 
D flip-flop 143 which temporarily stores pixel data sup- 
plied from the pixel address counter 71 , a comparator 
144 which compares the image data temporarily 
stored in the first D flip-flop 141 with the Image data 
supplied from the clipping processing section 1 30 and 
first to third change-over switches 146, 147 and 148 
to which a compared output from the comparator 144 
is supplied through an AND gate circuit 145 as a 
switching control signal. 

The first D flip-flop 141 is operated as a maximum 
value detector which selectively latches image data 
larger than the Image data previously latched when 
the image data is supplied to the data input terminal 
through the first change-over switch 146 whose 
switching operation is controlled by the compared out- 
put of the above-mentioned comparator 144. Thus, it 
is possible to detect image data of the defective pixel 
which outputs the camera signal of the maximum sig- 
nal level. 

Then, the second D flip-flop 142 latches tine 
address data supplied to the data input terminal 
thereof through the second change-over switch 147 
which is changed in position together with the first 
change-over switch 146 by the compared output of 
the comparator 144. Consequently, the line address 



data indicative of the position of the defective pixel Is 
latched in the the second D flip-flop 142. 

5 The third D flip-flop 143 latches pixel address 

data supplied to the data input terminal thereof 
through the third change-over switch 148 which is 
changed in position together with the first change- 
over switch 146 by the compared output from the com- 

10 parator 144. Thus, the pixel data indicative of the 
position of the defective pixel is latched in the third D 
flip-flop 143. 

The line address data and the pixel data latched 
in the second and third D flip-flops 142 and 143 are 

15 written in the memory 6g through the system control- 
ler 68 as the defective pixel position data together with 
data indicative of the channel selected at that time. 

While perfonrting the defect correcting process 
by using the defective pixel positk>n data written In the 

20 memory 69. the above-mentiohked defective position 
detecting and processing section 140 sequentially 
detects the positions of the defective pixels which pre- 
sent a peculiar signal level. 

As described above, according to the second 

25 embodiment of the image defect correcting circuit of 
the present invention, the levels of video signals out- 
put from a plurality of pixels located near the defective 
pixel are compared with each other to thereby dis- 
cnminate the pattern of the object image near the 

30 defective pixel and the video information at the posi- 
tion of the defective pixel Is obtained by the interpor- 
. tion on the basis of the video infomnation of the pixels 
selected in response to this pattern. Therefore, it is 
possible to perfonm the interpolation processing in 

35 which a portion whose defective portk>n Is corrected 
can be prevented from t>ecoming conspicuous. 

Let us explain next a video image defect correct- 
ing circuit of the solid state image pickup apparatus 
which corrects the signal level of the camera output 

40 when a constant bias voltage is always applied to the 
camera output responsive to the amount of incident 
light due to the crystal defect of a solid state imager 
element 

Conventionally, in the blemish correcting circuit 
45 which corrects the signal level of the output signal 
from the solid state imager element, data indicative of 
the position of defective pixel involved in the solid 
state imager element and data concerning blemish 
level contained in the output signal from the solid state 
50 imager element are stored beforehand in the memory, 
and on the basis of the data read out from this mem- 
ory, the deterioration of image quality due to the cam- 
era output from the above-mentioned defective pixel 
is corrected by the signal processing. The data indi- 
55 cative of the position of the defective pbcel involved in 
the solid state imager element and the blemish level 
are detected beforehand by the production line and 
those data are written in a programmable read only 
memory. 

Incidentally, in the conventional blemish conrect- 

15 
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ing circuit, the position data of defective pixel involved 
in the solid state imager element and the blemish level 
thereof are delected beforehand and the conreclion 5 
processing is performed by using the programmable 
read only memory in which the above data are written. 
As a consequence, when the blemish level is changed 
in an aging change fashion or when a new defective 
pixel occurs, there is then the disadvantage that the io 
proper blemish correction processing cannot be effec- 
ted. 

Therefore, In order to eliminate the aforenoted 
disadvantages of the prior-art blemish correcting cir- 
cuit, the present invention is intended to provide a is 
blemish correcting circuit or a third embodimemnt of 
the video image correcting circuit which corrects the 
signal level of the output signal from the defective 
pixel. According to the third embodiment of the pre- 
sent invention, even when the blemish level is 20 
changed in an aging change manner or when a new 
defective pixel occurs, a proper blemish correction 
processing can be effected. 

A third emtxKiiment of the video image correcting 
circuit of the solid state imager according to the pre- 25 
sent invention will be described with reference to the 
drawings. 

In the third embodiment illustrated in Fig. 19, the 
present invention is applied to a solid state image sen- 
sor 204 in which an object image is focused on a 30 
target screen by an image pickup light introduced 
thereto through a camera optical system 203 such as 
a camera lens 201, an iris mechanism 202 and so on. 

In this solid state imager, the iris mechanism 202 
of the above-mentioned camera optical system 203 3S 
carries out the control of the amount of the image 
pickup light illuminated on the target screen of the 
above-mentioned solid state image sensor 204. This 
iris mechanism 202 is opened and/or closed by an iris 
drive section 206 which is operated in response to an 40 
iris control signal from a system controller 205. 

Further, the CCD image sensor 204 is driven by 
a CCD driver section 204 to which a CCD control sig- 
nal is supplied from the system controller 205 and 
picks up images in the operation mode designated by 45 
the system controller 205. 

Herein as the solid state image sensor 204. It is 
possible to employ a CCD image sensor of interiine 
transfer type which is comprised of as, for example, 
shown in Fig. 1 0, a number of light receiving sections so 
S corresponding to respective pixels arrayed in a mat- 
rix fashion, the vertical transfer registers VR provided 
on one side of these light receiving section S along the 
longitudinal direction and the horizontal transfer regi- 
ster HR provided at the end sides of these vertical 55 
transfer registers VR. In this CCD image sensor, sig- 
nal charges obtained from the respective light receiv- 
ing sections S in response to the amount of light 
received are transferred to the vertical transfer regis- 
ters VR corresponding to every vertical lines at, for 



example, every field period or at every frame period 
and the signal charges are transferred to the horizon- 
tal transfer register HR through the respective vertical 
transfer registers VR. whereby the signal charge of 
every horizontal line is produced from this horizontal 
transfer register HR as a camera output 

The blemish correcting circuit, which is provided 
as the video image defect correcting circuit in this 
embodiment, includes a signal subtracter 209 to 
which the camera output from the CCD image sensor 
204 is supplied through a pre-amplifier 208. 

This signal subtracter 209 is supplied with a blem- 
ish con-ecting signal through a mulUplier212, and this 
blemish conrecting signal results from converting 
blernish con-ecting data read out from a first memory 
210 into analog, blemish conrecting signal by a digital- 
to-analog (D/A) converter 21 1 . Data write and read of 
a first memory 21 0 is controlled by the system control- 
ler 205. This blemish correcting signal is subb-acted 
from the camera output signal of the CCD image sen- 
sor 204. thereby the blemish correction processing 
being performed. 

The multiplier 212 is supplied with a detection out- 
put signal from a temperature sensor 213 which 
detects the temperature of the CCD image sensor 
204, that is. a detection output signal indicating the 
present temperature of the CCD image sensor 204. 
This detection output signal is multiplied with the 
analog blemish coirecUon signal from the D/A con- 
verter 211, whereby the blemish con-ection signal is 
corrected in temperature. 

A subtracted output signal from the signal sub- 
tracter 209 is digitized by an A/D converter 214, and 
fed to a digital signal processing section of the suc- 
ceeding stage (not shown) as the camera output data 
and to an adder 215. 

The adder 215 supplies its added output data 
through a change-over switch 216 to a second mem- 
ory 217 whose write and read of data are controlled 
by the system controller 205. 

Data read out of the second memory 217 is sup- 
plied to the adder 215 and is also supplied through a 
high-pass filter 218 to the change-over switch 216. 
Further, this second memory 217 Is utilized as a woric- 
ing memory of a computing apparatus 219 which gen- 
erates blemish con-ecting data indicative of the 
position and the peculiar level of the pixel of pixels of 
the CCD image sensor 204 and which outputs the sig- 
nal of peculiar level under the condition that a light is 
not incident thereon. The second memory 217 is con- 
nected to the above computing apparatus 219. 

Further, the detection output signal indicative of 
the current temperature of the CCD image sensor 204 
is supplied from the temperature sensor 213 to an 
analog-lo-digital (A/D) converter 220, in which it is 
converted into a digital signal and fed to the comput- 
ing apparatus 219. 

In the case of the blemish detection mode, the 



29 



EP 0 440 563 A2 



30 



system controller 205 supplies the iris drive section 
206 with the iris control signal which closes the iris 
mechanism 202 that controls the amount of light 
illuminated on the target screen of the solid state 
image sensor 204, and also supplies the CCD drive 
section 207 with the CCD control signal which desig- 
nates the frame read-out mode of the CCD image sen- 
sor 2S4. In the blemish detection mode, the read out 
of the first mennory 210 Is controlled by the system 
contrbller205, there by.reading out from the first menv 
ory 210 blemish correction data whose correction 
level is zero, thus the blemish correctlori processing 
bein^~ ended. 

The caiinera output signal from the defective pixel 
obtained from the CCD image sensor 204 under the 
condition that the iris mechanism 202 is closed 
increases its signal level, i.e.. blemish level In propor- 
tion to the charge accumulation time in the above- 
mentioned defective pixel. 

Therefore, in the blemish correcting circuit of this 
embodiment, the system controller 205 controls the 
,v CCD^drive section 207 to extend the charge accumu- 
latiort' tinrie so that the charge is accumulated in a 
range which does not exceed the dynamic range of 
the circuttl= 

Further, In the blemish detecting mode, the sys- 
tem Controller 205 controls the change-over switch 

21 6 so as to select the adder 21 5, and the system con- 
troller 205 writes the camera output data from the AJO 
converter 214 In the second memory 217 In synchron- 
ism with the read-out of the camera output signal from 
the CCD image sensor 204. Further, the system con- 
troller 205 read out the camera output data written in 
the second memory 217, the read-out camera output 
data is synchronously added with camera output data 
from the A/D converter 214 by the adder 215 and the 
added result Is repeatedly written in the second mem- 
ory 217. thereby improving a S/N ratio. 

Then, the system controller 205 controls the 
change-over switch 216 so as to select the high-pass 
filter 218. Camera output data is read put of the sec- 
ond memory 217 and written in the second memory 

217 via the high-pass filter 218. In other words, the 
camera output data whose DC component and whose 
low band noise component are eliminated by the high- 
pass filter 218 Is written in the second memory 217. 

On the basis of the camera output data thus writ- 
ten in the second memory 217, the system controller 
205 controls the above computing apparatus 219 
such that the computing apparatus 219 performs the 
computing processing to generata position data indi- 
cative of the position of defective pixel which outputs 
a signal of peculiar level under the condition that no 
light is illuminated and blemish level data indicative of 
the peculiar level of the signal output from the defec- 
tive pixel indicated by the position data. 

The above-described computing apparatus 219 
responds to a temperature at which the charge 



accumulation time of the CCD image sensor 204, the 
number of synchronizing addition and the above- 

5 mentioned camera outpuit data are stored in the sec- 
ond memory 21 7 to perfonm the computing 
processing to normalize the camera output data writ- 
ten in the second memory 21 7, thereby generating the 
blemish level data together with the position data. The 

10 blemish level data generated from the computing 
apparatus 219 are written in the first memory 210 as 
the blemish correction data together with the position 
data under the control of the system controller 205. 
Then, in the blemish correcting circuit of this 

15 embodiment, the blemish correction data written in 
the first memory 210 in the blemish detection mode is 
read out from the first memory 210 and converted to 
' analog data by the D/A converter 211 so that, when 
the user takes a picture in actual practice, a t)lemish 

20 correction signal is generated and the blemish correc- 
tion processing is carried out by the signal subtracter 
209. 

Incidentally, in accordance with the blemish cor- 
recting circuit of this embodinient, by utilizing a frame 

25 memory as the second memory 217. blemish data can 
be written in the first memory 210 by one operation. 
When a line memory is utilized as the second memory 
217, the blemish correction data may be written in the 
first memory 21 0 by operation more than the number 

30 of lines. Furthermore, blemish may be detected at 
every point by utilizing a register as shown In a fourth 
embodiment of the present invention shown in Fig. 20. 

The embodiment of Fig. 20 is different from the 
embodiment of Fig. 19 only in the arrangement of a 

35 blemish detecting section 230, and common con- 
stituents in Fig. 20 are marked with the same refer- 
ences, thereby the detailed arrangerhent need not be - 
made. 

The blemish detecting section 230 in the embo- 

40 diment shown in Fig. 20 is composed of an address 
counter 221 for counting the number of clocks from . 
the CCD drive section 207 to generate address data 
corresponding to respective pixels of the CCD image 
sensor 204, a high-pass filter 222 to which digital canrv 

45 era output data, which results from converting the 
camera output signal from the CCD image sensor 204 
by the A/D converter 214, is supplied, a comparator 
223 and an adder 224 to which the camera output 
data is supplied through the high-pass filter 222. first 

50 and second switches 225 and 226 which are changed 
in position by an output from the comparator 223, a 
first register 227 which temporarily stores the camera 
output data supplied from the high-pass filter 222 
through the first switch 225, a second register 228 for 

55 temporarily storing address data supplied from the 
address counter 221 through the second switch 226, 
and a third register 229 for temporarily storing added 
output data from the adder 224. 

In the blemish correcting circuit in this embodi- 
ment, in the blemish detection mode, the system con- 
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troller 205 causes the CCD image sensor 204 to oper- 
ate in the frame read-out mode under the condition 
that the iris mechanism 202 is closed. 5 

Then, the comparator 223 in the blemish detect- 
ing section 230 compares the cunrent camera output . 
data supplied through the high-pass filter 222 with the 
camera output data previously stored in the first regis- 
tre 227. When the current camera output data is larger io 
than the camera output data previously stored in the 
first registre 227, the comparator 223 changes the first 
switch 225 in position so that the cunrent camera out- 
put data is stored in the first register 227, and changes 
the second switch 226 in position such that the is 
address data indicative of the pixel position of the 
CCD image sensor 204 which generates the above 
present camera output is stored in the second register 
228. 

More precisely, the first switch 225. changed in 20 
position by the comparator 223, and the first register 

227 which stores the camera output data supplied 
through the first switch 225 are operated as a peak 
level detector which detects the peak level of the cam- 
era output data supplied through the high-pass filter 25 
222. Further, the second switch 226, changed in posi- 
tion by the comparator 223, and the second register 

228 which stores address data supplied from the 
address counter 221 through the second switch 226 

are operated as a detector which detects the pixel 30 
which produces the peak level data stored in the first 
register 227. that is, the position of the defective pixel. 

Address data indicating the defective pixel posi- 
tion at which the above-mentioned camera output 
data takes a peak value is stored in the second regi- 35 
sler 228. The address data indicating the defective 
pixel position is supplied to the system controller 205 
and the computing apparatus 219. 

Since the data latching timing of the third register 

229 which temporarily stores added output data of the 40 
adder 224 Is controlled by the system controller 205, 

the third register 229 latches camera output data, 
which are dervied from the defective pixel indicated by 
the address data latched in the second register and 
which are added by the adder 224 in a synchronizing 45 
fashion, to thereby generate caniera output data 
whose S/N ratio is improved. Camera output data 
obtained in the third register 229 is supplied to the 
above-mentioned computing apparatus. 

If it is determined by the computing apparatus 219 so 
that the camera output data obtained at the third regi- 
ster 229 is sufficiently larger tahn the noise level, this 
computing apparatus 29 responds to a temperature at 
which the charge accumulation time of the CCD 
image sensor 204, the number of addition perfonned 55 
in a synchronizing fashkjn, and the camera output 
data are latched in the second memory 217 to nor- 
malize the camera output data obtained at the third 
register 229, thereby blemish level data being gener- 
ated. The blemish level data obtained by the comput- 



ing apparatus 229 is written in the first memory 210 
together with the position data of the defective pixel 
indicated by the address data latched in the second 
register 228 as blemish conrection data. 

The blemish correction data written in the first 
memory 210 is read out fnam the first memory 210 and 
converted into the analog data by the D/A converter 
211. thereby forming a blemish conrection signal. 
Therefore, while executing the blemish correction pro- 
cessing, the above-mentioned blemish detection 
mode is repeatedly can-ied out until the camera output 
data obtained in the third register 229 becomes less 
than the noise level. 

The blemish conrection data thus written in the 
first memory 210 in the blemish detection mode is 
read out from the first memory 21 0 and converted into 
the analog data by the D/A converter 211 so that, in 
the actual camera mode, the blemish signal is gener- 
ated and the blemish correction processing is exec- 
uted by the signal subtracter. 

As described above, in the image defect correct- 
ing circuit according to the present invention, of the 
respective pixels of the image pickup elements, the 
position data Indicating the position of the pixel which 
outputs the signal of the peculiar level under the con- 
dition that no light is incident thereon and the blemish 
data indicating the peculiar leivel are generated and 
stored in the memory means. In the actual camera 
mode, on the basis of the output signal from the mem- 
ory means, the signal of the level Indicated by the 
blemish level data is subtracted from the output signal 
of the pixel of the position indicated by the above- 
mentioned position data, thereby correcting the signal 
level of the output signal from the pbcel Included in the 
solid state image pickup element such as the CCD or 
the like and which outputs the signal of the peculiar 
level under the condition that no light is Incident- In 
addition, when the blemish level of the Image pickup 
element is changed in an aging change fashion or 
when new defective pixel occurs, the proper blemish 
correction processing can be effected. 

Having described prefen^d embodiments of the 
invention with reference to the accompanying draw- 
ings, it is to be understood that the inventkDn is not 
limited to those precise embodiments and that various 
changes and modifications thereof could be effected 
by one skilled in the art without departing from the 
spirit or scope of the novel concepts of the invenUon 
as defined in the appended claims. 



Claims 

1. An image defect correcting circuitfor a solid state 
imager, comprising : 

a) comparing means for comparing levels of 
output signals from respective pixels of a sol id 
state image pickup elements illuminated on i ts 
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whole surface with a light of uniform bright- 
ness with a predetermined level ; 
b) position data generating means for s 
generating data Indicative of a position of pixel 
which outputs a signal of peculiar level on the 
basis of the compared result of said compar- 
' ing means ; 

' c) interpolating means for Interpolating an out- io 
put signal output from a pixel located at the 

' position indicated by said position data gener- 
ated from at least said position data generat- 
ing means by using an output signal derived 

^ fron other pixel ; and is 
d) switching means for selectively switching 
the output signals of said respective pixels 
and. an output signal of said Interpolating 
means on the basis of the output signal from 
said position data generating means. 20 

2. An image defect correcting circuit for a solid state 
Imager according to claim 1, wherein said posi- 
tibn data genierating means generates data indi- 
cative of a position of a pixel which outputs the 25 
signal of peculiar level when said image defect 
cbn-ecting circuit is connected to a power supply 
source. 

3. An image defect correcting circuit for a solid state 30 
imager according to claim 1» further comprising : 

a) an iris for controlling an amount of light inci- 
dent on said solid state image pickup element; 
and 

b) iris control means for controlling said iris. 35 
said iris control means closing said iris when 

said position data generating means gener- 
ates said position data. 

4. An image defect correcting circuit for a solid state 40 
imager, comprising : 

a) comparing means for comparing levels of 
output signals from respective pixels of a solid 
state image pickup elenrient illuminated on its 
whole surface with a light of uniform bright- 4S 
ness with a predetermined level ; 

b) positk)n data generating means for 
generating data Indicative of a position of a 
pixel which outputs a signal of peculiar level 

on the basis of the compared result of said so 
comparing means ; 

c) memory means for storing position data 
derived from at least said position data 
generating means ; 

d) interpolating means for interpolating an out- 55 
put signal output from the pixel located at the 
position indicated by the position data read 

out from said memory means by using an out- 
put signal of other pixel ; and 

e) switching means for selectively switching 



output signals of respective pixels and an out- 
put signal of said interpolating means on the 
basis of the output signal from said position 
data generating means. 

5. An Image defect correcting circuit for a solid state 
imager according to claim 4. wherein said posi- 
tion data generating means generates data indi- 
cative of a position of the pixel which outputs the 
signal of peculiar level when said image defect 
correcting circuit is powered. 

6. An image defect correcting circuit for a solid state 
imager according to claim 4, further comprising : 

a) an Iris for controlling an amount of light inci- 
dent on said solid state image pickup element; 
and 

b) iris control means for controlling said iris, 
said iris control means closing said iris when 
said position data generating means gener- 
ates said position data. 

7. An image defect correcting circuit according to 
claim 4, further comprising displaying means for 
displaying an operation guidance to an operator. 

a. An image defect correcting circuit according to 
claim 7, wherein said displaying means displays 
an information by which said operator is urged to 
pick up a white pattern. 

9. An image defect correcting circuit according to 
claim 4, further comprising : 

a) a filter supplied with an output signal of said 
switchingmeans and which eliminates a DC 
component and a low frequency component 
involved in said output signal ; and 

b) selective outputting means supplied with an 
output signal of said filter and for selectively 
outputting said output signal and a signal 
which results from phase-inverting said output 
signal, an output of said selective outputting 
means being supplied to said comparing 
means. 

10. An image defect correcting circuit according to 
claim g, wherein said selective outputting means 
selectively outputs said output signal and said 
phase-inverted output signal on the basis of data 
which indicates whether the present operation 
mode Is a white blemish detection mode or a 
black blemish detection mode. 

11. An image defect correcting circuit according to 
claim 4, further comprising : 

a) display means for displaying the output sig- 
nal of said switching means ; 

b) input means for displaying a marker on said 
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display means and outputting a defect posi- 
tion designating signal ; and 
c) second position data generating means for 5 
generating position data corresponding to a 
position at which said marker is displayed 
when said defect position designating signal 
is input by said input means, position data 
generated from said second position data io 
generating means being stored in said mem- 
ory means. 

12, An image defect correcting circuitfor a solid state 
imager, comprising : ts 

a) phase Inverting means for inverting phases 
of output signals of respective pixels of a solid 
state image pickup element illuminated on its 
while surface with a light of unifonn brightness 

in association with a read cycle of said solid 20 
slate Imager pickup element 

b) comparing means for comparing output sig- 
nals of said phase inverting means with a pre- 
determined level ; 

c) position data generating means for general- 25 
ing data indicative of a position of a pixel which 
outputs a signal of peculiar level on the basis 

of compared result of said comparing means; 

d) interpolating means for interpolating an out- 
put signal output from the pixel located at the 30 
position indicated by the position data read 

out from said memory means by using an out- 
put signal of other pixel ; and 

e) switching means for selectively switching 
output signals of said respective pixels and an 35 
output signal of said interpolating means on 

the basis of the output signal from said posi- 
tion data generating means. 

1 3. An image defect correcting circuit for a solid state 40 
imager in which a video information correcting to 

a position of a defective pixel of a plurality of 
pixels in a solid state image pickup element is 
generated by an interpolation processing on the 
basis of a video information of a certain pixel 45 
located at other position^ comprising : 

a) comparing means for comparing levels of 
video signals output from a plurality of pixels 
located near said defective pixel ; 

b) selecting means for selecting a video infer- 50 
mation of a pixel to be used in the interpolation 
processing on the basis of a compared result 

of said comparing means ; and 

c) interpolating means for generating a video 
information corresponding to the position of 55 
said defective pixel on the basis of the video 
information of the pixel selected by said 
selecting means by the interpolation proces- 
sing. 



14. An image defect correcting circuit for a solid state 
imager according to claim 13, wherein said com- 
paring means is composed of a register for stor- 
ing output signals of a plurality of pixels located 
in the vicinity of said defective pixel of said solid 
state image pickup element, absolute value com- 
puting means for computing an absolute value of 
level difference of output signals of respective 
pixels stored in said resistor, and absolute value 
comparing means for comparing respective com- 
puted results of said absolute value computing 
means and said selecting means is composed of 
a decoder for outputting selection control signal 
on the basis of computed results of said absolute 
value computing means, an output signal of said 
decoder being supplied to said interpolating 
means. 

1 5. An image defect correcting circuit for a solid state 
imager, comprising : 

a) position . data generating means for 
generating position data indicative of a posi- 
tion of a pixel of respective pixels of a solid 
state image pickup element and which outputs 
a signal of peculiar level under the condition 
that no light is incident on said solid state 
image pickup element ; 

b) blemish level data generating means for 
generating blemish level data indicative of a 
level of a signal output from the pixel indicated 
by position data from said position data 
generating means ; 

c) memory means for storing said position 
data and said blemish level data ; and 

d) correcting means for subtracting a signal of 
level indicated by said blemish level data from 
an output signal of the pixel located at the 
position indicated by said position data on the 
basis of an output signal from said memory 
means in the camera mode. 

16. An image defect correcting circuitfor a solid state 
imager, comprising : 

a) position data generating means for 
generating position data indicative of a posi- 
tion of a pixel of respective pixels of a solid 
state image pickup element and which outputs 
a signal of peculiar level under the condition 
that no light is incident on said solid stale 
image pickup element ; 

b) blemish level data generating means for 
generating blemish level data indicative of a 
level ofasignal output from the pixel indicated 
by position data from said position data 
generating means ; 

c) memory means for storing said position 
data and said blemish level data ; 

d) temperature measuring means for measur- 
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ing a temperature of said solid state image 
pickup element ; 

e) temperature correcting means for tern- 5 
perature-conrecting said blemish level data 
output from said memory means on the basis 
of an output signal of said temperature 
measuring means In the camera mode ; and 
O'correctlng means for subtracting a signal of io 
a level indicated by said temperature-correc- 
ted blemish level data from the output signal 
of the pixel located at the position indicated by 
said position data on the basis of an output 
signal of said temperature correcting means is 
and an output signal of said memory means. 

17. An image defect correcting circuit for a solid state 
imager according to claim 15» further comprising: 

a) an iris for controlling an amount of light inci- 20 
dent on said solid state image pickup element; 

and 

b) iris control means for controlling said iris, 
said iris control means closing said iris when 
said position data generating means gener- 25 
ates said position data. 

18. An image defect correcting circuit for a solid state 
image imger according to claim 15, further conrv 
prising driving means for driving said solid state 30 
image pickup element, wherein said driving 
means extends a duration of a charge accummu- 
lation time of said solid state image pickup ele- 
ment longer than that of a charge accumulation 

time of the camera mode when said blemish level 35 
data generating means generates said blemish 
level data. 

19. An image defect correcting circuit for a solid state 
imager according to claim 15, further comprisig 40 
nonmalizing means for nomnalizing said blemish 
level data generated by said blemish level data 
generating means in response to the charge 
accumulation time of said solid state image 
pickup element and the temperature of said solid 45 
state image pickup element. 
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